Genetically guided precision medicine clinical decision support tools: a systematic review.

OBJECTIVES: Patient care using genetics presents complex challenges. Clinical decision support (CDS) tools are a potential solution because they provide patient-specific risk assessments and/or recommendations at the point of care. This systematic review evaluated the literature on CDS systems which have been implemented to support genetically guided precision medicine (GPM). MATERIALS AND METHODS: A comprehensive search was conducted in MEDLINE and Embase, encompassing January 1, 2011-March 14, 2023. The review included primary English peer-reviewed research articles studying humans, focused on the use of computers to guide clinical decision-making and delivering genetically guided, patient-specific assessments, and/or recommendations to healthcare providers and/or patients. RESULTS: The search yielded 3832 unique articles. After screening, 41 articles were identified that met the inclusion criteria. Alerts and reminders were the most common form of CDS used. About 27 systems were integrated with the electronic health record; 2 of those used standards-based approaches for genomic data transfer. Three studies used a framework to analyze the implementation strategy. DISCUSSION: Findings include limited use of standards-based approaches for genomic data transfer, system evaluations that do not employ formal frameworks, and inconsistencies in the methodologies used to assess genetic CDS systems and their impact on patient outcomes. CONCLUSION: We recommend that future research on CDS system implementation for genetically GPM should focus on implementing more CDS systems, utilization of standards-based approaches, user-centered design, exploration of alternative forms of CDS interventions, and use of formal frameworks to systematically evaluate genetic CDS systems and their effects on patient care.

Decision support systems for antibiotic prescription in hospitals: a survey with hospital managers on factors for implementation.

BACKGROUND: Inappropriate antimicrobial use, such as antibiotic intake in viral infections, incorrect dosing and incorrect dosing cycles, has been shown to be an important determinant of the emergence of antimicrobial resistance. Artificial intelligence-based decision support systems represent a potential solution for improving antimicrobial prescribing and containing antimicrobial resistance by supporting clinical decision-making thus optimizing antibiotic use and improving patient outcomes. OBJECTIVE: The aim of this research was to examine implementation factors of artificial intelligence-based decision support systems for antibiotic prescription in hospitals from the perspective of the hospital managers, who have decision-making authority for the organization. METHODS: An online survey was conducted between December 2022 and May 2023 with managers of German hospitals on factors for decision support system implementation. Survey responses were analyzed from 118 respondents through descriptive statistics. RESULTS: Survey participants reported openness towards the use of artificial intelligence-based decision support systems for antibiotic prescription in hospitals but little self-perceived knowledge in this field. Artificial intelligence-based decision support systems appear to be a promising opportunity to improve quality of care and increase treatment safety. Along with the Human-Organization-Technology-fit model attitudes were presented. In particular, user-friendliness of the system and compatibility with existing technical structures are considered to be important for implementation. The uptake of decision support systems also depends on the ability of an organization to create a facilitating environment that helps to address the lack of user knowledge as well as trust in and skepticism towards these systems. This includes the training of user groups and support of the management level. Besides, it has been assessed to be important that potential users are open towards change and perceive an added value of the use of artificial intelligence-based decision support systems. CONCLUSION: The survey has revealed the perspective of hospital managers on different factors that may help to address implementation challenges for artificial intelligence-based decision support systems in antibiotic prescribing. By combining factors of user perceptions about the systems´ perceived benefits with external factors of system design requirements and contextual conditions, the findings highlight the need for a holistic implementation framework of artificial intelligence-based decision support systems.

Academic Detailing as a Health Information Technology Implementation Method: Supporting the Design and Implementation of an Emergency Department-Based Clinical Decision Support Tool to Prevent Future Falls.

BACKGROUND: Clinical decision support (CDS) tools that incorporate machine learning-derived content have the potential to transform clinical care by augmenting clinicians' expertise. To realize this potential, such tools must be designed to fit the dynamic work systems of the clinicians who use them. We propose the use of academic detailing-personal visits to clinicians by an expert in a specific health IT tool-as a method for both ensuring the correct understanding of that tool and its evidence base and identifying factors influencing the tool's implementation. OBJECTIVE: This study aimed to assess academic detailing as a method for simultaneously ensuring the correct understanding of an emergency department-based CDS tool to prevent future falls and identifying factors impacting clinicians' use of the tool through an analysis of the resultant qualitative data. METHODS: Previously, our team designed a CDS tool to identify patients aged 65 years and older who are at the highest risk of future falls and prompt an interruptive alert to clinicians, suggesting the patient be referred to a mobility and falls clinic for an evidence-based preventative intervention. We conducted 10-minute academic detailing interviews (n=16) with resident emergency medicine physicians and advanced practice providers who had encountered our CDS tool in practice. We conducted an inductive, team-based content analysis to identify factors that influenced clinicians' use of the CDS tool. RESULTS: The following categories of factors that impacted clinicians' use of the CDS were identified: (1) aspects of the CDS tool's design (2) clinicians' understanding (or misunderstanding) of the CDS or referral process, (3) the busy nature of the emergency department environment, (4) clinicians' perceptions of the patient and their associated fall risk, and (5) the opacity of the referral process. Additionally, clinician education was done to address any misconceptions about the CDS tool or referral process, for example, demonstrating how simple it is to place a referral via the CDS and clarifying which clinic the referral goes to. CONCLUSIONS: Our study demonstrates the use of academic detailing for supporting the implementation of health information technologies, allowing us to identify factors that impacted clinicians' use of the CDS while concurrently educating clinicians to ensure the correct understanding of the CDS tool and intervention. Thus, academic detailing can inform both real-time adjustments of a tool's implementation, for example, refinement of the language used to introduce the tool, and larger scale redesign of the CDS tool to better fit the dynamic work environment of clinicians.

Comparing the Effectiveness of a Clinical Decision Support Tool in Reducing Pediatric Opioid Dose Calculation Errors: PediPain App vs. Traditional Calculators - A Simulation-Based Randomised Controlled Study.

Wrong dose calculation medication errors are widespread in pediatric patients mainly due to weight-based dosing. PediPain app is a clinical decision support tool that provides weight- and age- based dosages for various analgesics. We hypothesized that the use of a clinical decision support tool, the PediPain app versus pocket calculators for calculating pain medication dosages in children reduces the incidence of wrong dosage calculations and shortens the time taken for calculations. The study was a randomised controlled trial comparing the PediPain app vs. pocket calculator for performing eight weight-based calculations for opioids and other analgesics. Participants were healthcare providers routinely administering opioids and other analgesics in their practice. The primary outcome was the incidence of wrong dose calculations. Secondary outcomes were the incidence of wrong dose calculations in simple versus complex calculations; time taken to complete calculations; the occurrence of tenfold; hundredfold errors; and wrong-key presses. A total of 140 residents, fellows and nurses were recruited between June 2018 and November 2019; 70 participants were randomized to control group (pocket calculator) and 70 to the intervention group (PediPain App). After randomization two participants assigned to PediPain group completed the simulation in the control group by mistake. Analysis was by intention-to-treat (PediPain app = 68 participants, pocket calculator = 72 participants). The overall incidence of wrong dose calculation was 178/576 (30.9%) for the control and 23/544 (4.23%) for PediPain App, P < 0·001. The risk difference was - 32.8% [-38.7%, -26.9%] for complex and - 20.5% [-26.3%, -14.8%] for simple calculations. Calculations took longer within control group (median of 69 Sects. [50, 96]) compared to PediPain app group, (median 48 Sects. [38, 63]), P < 0.001. There were no differences in other secondary outcomes. A weight-based clinical decision support tool, the PediPain app reduced the incidence of wrong doses calculation. Clinical decision support tools calculating medications may be valuable instruments for reducing medication errors, especially in the pediatric population.

Decision discovery using clinical decision support system decision log data for supporting the nurse decision-making process.

BACKGROUND: Decision-making in healthcare is increasingly complex; notably in hospital environments where the information density is high, e.g., emergency departments, oncology departments, and psychiatry departments. This study aims to discover decisions from logged data to improve the decision-making process. METHODS: The Design Science Research Methodology (DSRM) was chosen to design an artifact (algorithm) for the discovery and visualization of decisions. The DSRM's different activities are explained, from the definition of the problem to the evaluation of the artifact. During the design and development activities, the algorithm itself is created. During the demonstration and evaluation activities, the algorithm was tested with an authentic synthetic dataset. RESULTS: The results show the design and simulation of an algorithm for the discovery and visualization of decisions. A fuzzy classifier algorithm was adapted for (1) discovering decisions from a decision log and (2) visualizing the decisions using the Decision Model and Notation standard. CONCLUSIONS: In this paper, we show that decisions can be discovered from a decision log and visualized for the improvement of the decision-making process of healthcare professionals or to support the periodic evaluation of protocols and guidelines.

Ontology-based decision support systems for diabetes nutrition therapy: A systematic literature review.

Diabetes is a non-communicable disease that has reached epidemic proportions, affecting 537 million people globally. Artificial Intelligence can support patients or clinicians in diabetes nutrition therapy - the first medical therapy in most cases of Type 1 and Type 2 diabetes. In particular, ontology-based recommender and decision support systems can deliver a computable representation of experts' knowledge, thus delivering patient-tailored nutritional recommendations or supporting clinical personnel in identifying the most suitable diet. This work proposes a systematic literature review of the domain ontologies describing diabetes in such systems, identifying their underlying conceptualizations, the users targeted by the systems, the type(s) of diabetes tackled, and the nutritional recommendations provided. This review also delves into the structure of the domain ontologies, highlighting several aspects that may hinder (or foster) their adoption in recommender and decision support systems for diabetes nutrition therapy. The results of this review process allow to underline how recommendations are formulated and the role of clinical experts in developing domain ontologies, outlining the research trends characterizing this research area. The results also allow for identifying research directions that can foster a preeminent role for clinical experts and clinical guidelines in a cooperative effort to make ontologies more interoperable - thus enabling them to play a significant role in the decision-making processes about diabetes nutrition therapy.

An innovative artificial intelligence-based method to compress complex models into explainable, model-agnostic and reduced decision support systems with application to healthcare (NEAR).

BACKGROUND AND OBJECTIVE: In everyday clinical practice, medical decision is currently based on clinical guidelines which are often static and rigid, and do not account for population variability, while individualized, patient-oriented decision and/or treatment are the paradigm change necessary to enter into the era of precision medicine. Most of the limitations of a guideline-based system could be overcome through the adoption of Clinical Decision Support Systems (CDSSs) based on Artificial Intelligence (AI) algorithms. However, the black-box nature of AI algorithms has hampered a large adoption of AI-based CDSSs in clinical practice. In this study, an innovative AI-based method to compress AI-based prediction models into explainable, model-agnostic, and reduced decision support systems (NEAR) with application to healthcare is presented and validated. METHODS: NEAR is based on the Shapley Additive Explanations framework and can be applied to complex input models to obtain the contributions of each input feature to the output. Technically, the simplified NEAR models approximate contributions from input features using a custom library and merge them to determine the final output. Finally, NEAR estimates the confidence error associated with the single input feature contributing to the final score, making the result more interpretable. Here, NEAR is evaluated on a clinical real-world use case, the mortality prediction in patients who experienced Acute Coronary Syndrome (ACS), applying three different Machine Learning/Deep Learning models as implementation examples. RESULTS: NEAR, when applied to the ACS use case, exhibits performances like the ones of the AI-based model from which it is derived, as in the case of the Adaptive Boosting classifier, whose Area Under the Curve is not statistically different from the NEAR one, even the model's simplification. Moreover, NEAR comes with intrinsic explainability and modularity, as it can be tested on the developed web application platform (https://neardashboard.pythonanywhere.com/). CONCLUSIONS: An explainable and reliable CDSS tailored to single-patient analysis has been developed. The proposed AI-based system has the potential to be used alongside the clinical guidelines currently employed in the medical setting making them more personalized and dynamic and assisting doctors in taking their everyday clinical decisions.

Developing a clinical decision support system software prototype that assists in the management of patients with self-harm in the emergency department: protocol of the PERMANENS project.

BACKGROUND: Self-harm presents a significant public health challenge. Emergency departments (EDs) are crucial healthcare settings in managing self-harm, but clinician uncertainty in risk assessment may contribute to ineffective care. Clinical Decision Support Systems (CDSSs) show promise in enhancing care processes, but their effective implementation in self-harm management remains unexplored. METHODS: PERMANENS comprises a combination of methodologies and study designs aimed at developing a CDSS prototype that assists clinicians in the personalized assessment and management of ED patients presenting with self-harm. Ensemble prediction models will be constructed by applying machine learning techniques on electronic registry data from four sites, i.e., Catalonia (Spain), Ireland, Norway, and Sweden. These models will predict key adverse outcomes including self-harm repetition, suicide, premature death, and lack of post-discharge care. Available registry data include routinely collected electronic health record data, mortality data, and administrative data, and will be harmonized using the OMOP Common Data Model, ensuring consistency in terminologies, vocabularies and coding schemes. A clinical knowledge base of effective suicide prevention interventions will be developed rooted in a systematic review of clinical practice guidelines, including quality assessment of guidelines using the AGREE II tool. The CDSS software prototype will include a backend that integrates the prediction models and the clinical knowledge base to enable accurate patient risk stratification and subsequent intervention allocation. The CDSS frontend will enable personalized risk assessment and will provide tailored treatment plans, following a tiered evidence-based approach. Implementation research will ensure the CDSS' practical functionality and feasibility, and will include periodic meetings with user-advisory groups, mixed-methods research to identify currently unmet needs in self-harm risk assessment, and small-scale usability testing of the CDSS prototype software. DISCUSSION: Through the development of the proposed CDSS software prototype, PERMANENS aims to standardize care, enhance clinician confidence, improve patient satisfaction, and increase treatment compliance. The routine integration of CDSS for self-harm risk assessment within healthcare systems holds significant potential in effectively reducing suicide mortality rates by facilitating personalized and timely delivery of effective interventions on a large scale for individuals at risk of suicide.

Clinical decision support tools useful for identifying sepsis risk.

PURPOSE: Evaluate the effectiveness of the clinical decision support tools (CDSTs), POC Advisor (POCA), and Modified Early Warning System (MEWS) in identifying sepsis risk and influencing time to treatment for inpatients, comparing their respective alert mechanisms. METHODS: This study was conducted at two academic university medical center hospitals. Data from adult inpatients in medical-surgical and telemetry units were analyzed from January 1, 2020, to December 31, 2020. Criteria included sepsis-related ICD-10 codes, antibiotic administration, and ordered sepsis labs. Subsequent statistical analyses utilized Fisher's exact test and Wilcoxon Rank Sum test, focusing on mortality differences by age, sex, and race/ethnicity. RESULTS: Among 744 patients, 143 sepsis events were identified, with 83% already receiving treatment upon CDST alert. Group 1 (POCA alert) showed reduced response time compared with MEWS, while Group 3 (MEWS) experienced longer time to treatment. Group 4 included sepsis events missed by both systems. Mortality differences were not significant among the groups. CONCLUSION: While CDSTs play a role, nursing assessment and clinical judgment are crucial. This study recognized the potential for alarm fatigue due to a high number of CDST-driven alerts, while emphasizing the importance of a collaborative approach for prompt sepsis treatment and potential reduction in sepsis-related mortality.

Developing an integrated clinical decision support system for the early identification and management of kidney disease-building cross-sectoral partnerships.

BACKGROUND: The burden of chronic conditions is growing in Australia with people in remote areas experiencing high rates of disease, especially kidney disease. Health care in remote areas of the Northern Territory (NT) is complicated by a mobile population, high staff turnover, poor communication between health services and complex comorbid health conditions requiring multidisciplinary care. AIM: This paper aims to describe the collaborative process between research, government and non-government health services to develop an integrated clinical decision support system to improve patient care. METHODS: Building on established partnerships in the government and Aboriginal Community-Controlled Health Service (ACCHS) sectors, we developed a novel digital clinical decision support system for people at risk of developing kidney disease (due to hypertension, diabetes, cardiovascular disease) or with kidney disease. A cross-organisational and multidisciplinary Steering Committee has overseen the design, development and implementation stages. Further, the system's design and functionality were strongly informed by experts (Clinical Reference Group and Technical Working Group), health service providers, and end-user feedback through a formative evaluation. RESULTS: We established data sharing agreements with 11 ACCHS to link patient level data with 56 government primary health services and six hospitals. Electronic Health Record (EHR) data, based on agreed criteria, is automatically and securely transferred from 15 existing EHR platforms. Through clinician-determined algorithms, the system assists clinicians to diagnose, monitor and provide guideline-based care for individuals, as well as service-level risk stratification and alerts for clinically significant events. CONCLUSION: Disconnected health services and separate EHRs result in information gaps and a health and safety risk, particularly for patients who access multiple health services. However, barriers to clinical data sharing between health services still exist. In this first phase, we report how robust partnerships and effective governance processes can overcome these barriers to support clinical decision making and contribute to holistic care.

Systematic analysis of ChatGPT, Google search and Llama 2 for clinical decision support tasks.

It is likely that individuals are turning to Large Language Models (LLMs) to seek health advice, much like searching for diagnoses on Google. We evaluate clinical accuracy of GPT-3·5 and GPT-4 for suggesting initial diagnosis, examination steps and treatment of 110 medical cases across diverse clinical disciplines. Moreover, two model configurations of the Llama 2 open source LLMs are assessed in a sub-study. For benchmarking the diagnostic task, we conduct a naïve Google search for comparison. Overall, GPT-4 performed best with superior performances over GPT-3·5 considering diagnosis and examination and superior performance over Google for diagnosis. Except for treatment, better performance on frequent vs rare diseases is evident for all three approaches. The sub-study indicates slightly lower performances for Llama models. In conclusion, the commercial LLMs show growing potential for medical question answering in two successive major releases. However, some weaknesses underscore the need for robust and regulated AI models in health care. Open source LLMs can be a viable option to address specific needs regarding data privacy and transparency of training.

Clinical Decision Support Principles for Quality Improvement and Research.

Pediatric hospitalists frequently interact with clinical decision support (CDS) tools in patient care and use these tools for quality improvement or research. In this method/ology paper, we provide an introduction and practical approach to developing and evaluating CDS tools within the electronic health record. First, we define CDS and describe the types of CDS interventions that exist. We then outline a stepwise approach to CDS development, which begins with defining the problem and understanding the system. We present a framework for metric development and then describe tools that can be used for CDS design (eg, 5 Rights of CDS, "10 commandments," usability heuristics, human-centered design) and testing (eg, validation, simulation, usability testing). We review approaches to evaluating CDS tools, which range from randomized studies to traditional quality improvement methods. Lastly, we discuss practical considerations for implementing CDS, including the assessment of a project team's skills and an organization's information technology resources.

ChatGPT in Pediatrics: Unraveling its Significance as a Clinical Decision Support Tool.

The integration of artificial intelligence in pediatrics holds transformative potential, reshaping healthcare through innovative approaches to diagnosis, treatment planning, and tailored clinical decision support. In the evaluation of ChatGPT's performance in pediatric case scenarios, the model displayed varying levels of proficiency suggesting the need for continuous refinement and collaboration with senior pediatricians for reliable pediatric decision support.

Developing and Testing the Usability of a Novel Child Abuse Clinical Decision Support System: Mixed Methods Study.

BACKGROUND: Despite the impact of physical abuse on children, it is often underdiagnosed, especially among children evaluated in general emergency departments (EDs) and those belonging to racial or ethnic minority groups. Electronic clinical decision support (CDS) can improve the recognition of child physical abuse. OBJECTIVE: We aimed to develop and test the usability of a natural language processing-based child abuse CDS system, known as the Child Abuse Clinical Decision Support (CA-CDS), to alert ED clinicians about high-risk injuries suggestive of abuse in infants' charts. METHODS: Informed by available evidence, a multidisciplinary team, including an expert in user design, developed the CA-CDS prototype that provided evidence-based recommendations for the evaluation and management of suspected child abuse when triggered by documentation of a high-risk injury. Content was customized for medical versus nursing providers and initial versus subsequent exposure to the alert. To assess the usability of and refine the CA-CDS, we interviewed 24 clinicians from 4 EDs about their interactions with the prototype. Interview transcripts were coded and analyzed using conventional content analysis. RESULTS: Overall, 5 main categories of themes emerged from the study. CA-CDS benefits included providing an extra layer of protection, providing evidence-based recommendations, and alerting the entire clinical ED team. The user-centered, workflow-compatible design included soft-stop alert configuration, editable and automatic documentation, and attention-grabbing formatting. Recommendations for improvement included consolidating content, clearer design elements, and adding a hyperlink with additional resources. Barriers to future implementation included alert fatigue, hesitancy to change, and concerns regarding documentation. Facilitators of future implementation included stakeholder buy-in, provider education, and sharing the test characteristics. On the basis of user feedback, iterative modifications were made to the prototype. CONCLUSIONS: With its user-centered design and evidence-based content, the CA-CDS can aid providers in the real-time recognition and evaluation of infant physical abuse and has the potential to reduce the number of missed cases.

Optimising interruptive clinical decision support alerts for antithrombotic duplicate prescribing in hospital.

INTRODUCTION: Duplicate prescribing clinical decision support alerts can prevent important prescribing errors but are frequently the cause of much alert fatigue. Stat dose prescriptions are a known reason for overriding these alerts. This study aimed to evaluate the effect of excluding stat dose prescriptions from duplicate prescribing alerts for antithrombotic medicines on alert burden, prescriber adherence, and prescribing. MATERIALS AND METHODS: A before (January 1st, 2017 to August 31st, 2022) and after (October 5th, 2022 to September 30th, 2023) study was undertaken of antithrombotic duplicate prescribing alerts and prescribing following a change in alert settings. Alert and prescribing data for antithrombotic medicines were joined, processed, and analysed to compare alert rates, adherence, and prescribing. Alert burden was assessed as alerts per 100 prescriptions. Adherence was measured at the point of the alert as whether the prescriber accepted the alert and following the alert as whether a relevant prescription was ceased within an hour. Co-prescribing of antithrombotic stat dose prescriptions was assessed pre- and post-alert reconfiguration. RESULTS: Reconfiguration of the alerts reduced the alert rate by 29 % (p < 0.001). The proportion of alerts associated with cessation of antithrombotic duplication significantly increased (32.8 % to 44.5 %, p < 0.001). Adherence at the point of the alert increased 1.2 % (4.8 % to 6.0 %, p = 0.012) and 11.5 % (29.4 % to 40.9 %, p < 0.001) within one hour of the alert. When ceased after the alert over 80 % of duplicate prescriptions were ceased within 2 min of overriding. Antithrombotic stat dose co-prescribing was unchanged for 4 out of 5 antithrombotic duplication alert rules. CONCLUSION: By reconfiguring our antithrombotic duplicate prescribing alerts, we reduced alert burden and increased alert adherence. Many prescribers ceased duplicate prescribing within 2 min of alert override highlighting the importance of incorporating post-alert measures in accurately determining prescriber alert adherence.

Design and implementation of clinical decision support systems in mental health helpline Services: A systematic review.

BACKGROUND: Clinical Decision Support Systems (CDSSs) are electronic systems used to conduct assessments based on patient characteristics and to offer treatment recommendations for clinicians to consider during their decision-making processes. CDSSs are needed by mental health helpline services to optimise service delivery for clients and counsellors, while also collecting the data needed for the administration of the service. The aim of this systematic review was to provide a comprehensive overview of the design and implementation of CDSSs in mental health helpline services, to identify current issues in their design and implementation, and to provide recommendations that may address any identified issues. MATERIALS AND METHODS: Keywords related to mental health, helplines and CDSS were searched in three databases in April 2022 and September 2023. In total, 21 articles published between 1987 and 2023 met the inclusion criteria. RESULTS: The objectives of the mental health helplines services included in this study included suicide risk reduction, diagnosis, treatment and monitoring of mental health disorders, and support of clinicians or counsellors in making better and more accurate decisions by incorporating real-time data analysis. All included studies demonstrated co-design activities, however, the level and degree of end-user involvement differed across the studies. The factors that impact CDSS implementation success depend on the design and implementation approach, user experience and context. CDSS evaluations in the included studies assessed reliability, utility, user friendlessness, cost-effectivenessand participant satisfaction. Few studies considered data privacy and integration issues. CONCLUSION: More interactive methods should be adopted during the design of CDSSs for mental health helpline services. Increased frequency and intensity of user participation in system design, that goes beyond providing feedback on research materials, enables user opinions to be fully understood and addressed. Comprehensive frameworks should be developed to guide requirements gathering, system design and system evaluation practices. These factors are interrelated and may impact implementation success. From the outset therefore, the design of a CDSS in the mental health helpline domain should consider the full system development cycle.

Opioid Prescribing Rate for Nonoperative Distal Radius Fractures and Clinician Response to a Clinical Decision Support Alert.

BACKGROUND: Opioids are commonly prescribed for the management of acute orthopedic trauma pain, including nonoperative distal radius fractures. OBJECTIVES: This prospective study aimed to determine if a clinical decision support intervention influenced prescribing decisions for patients with known risk factors. We sought to quantify frequency of opioid prescriptions for acute nonoperative distal radius fractures treated. METHODS: We performed a prospective study at one large health care system. Utilizing umbrella code S52.5, we identified all distal radius fractures treated nonoperatively, and the encounters were merged with the Prescription Reporting with Immediate Medication Mapping (PRIMUM) database to identify encounters with opioid prescriptions and patients with risk factors for opioid use disorder. We used multivariable logistic regression to determine patient characteristics associated with the prescription of an opioid. Among encounters that triggered the PRIMUM alert, we calculated the percentage of encounters where the PRIMUM alert influenced the prescribing decision. RESULTS: Of 2984 encounters, 1244 (41.7%) included an opioid prescription. Age increment is a significant factor to more likely receive opioid prescriptions (p < 0.0001) after adjusting for other factors. Among encounters where the physician received an alert, those that triggered the alert for early refill were more likely to influence physicians' opioid prescribing when compared with other risk factors (p = 0.0088). CONCLUSION: Over 90% of patients (106/118) continued to receive an opioid medication despite having a known risk factor for abuse. Additionally, we found older patients were more likely to be prescribed opioids for nonoperatively managed distal radius fractures.

GC-CDSS: Personalized gastric cancer treatment recommendations system based on knowledge graph.

BACKGROUND: Gastric cancer (GC) is one of the most common malignant tumors in the world, posing a serious threat to human health. Currently, gastric cancer treatment strategies emphasize a multidisciplinary team (MDT) consultation approach. However, there are numerous treatment guidelines and insights from clinical trials. The application of AI-based Clinical Decision Support System (CDSS) in tumor diagnosis and screening is increasing rapidly. OBJECTIVE: The purpose of this study is to (1) summarize the treatment decision process for GC according to the treatment guidelines in China, and then create a knowledge graph (KG) for GC, (2) based on aforementioned KG, built a CDSS and conducted an initial feasibility evaluation for the current system. METHODS: Firstly, we summarized the decision-making process for treatment of GC. Then, we extracted relevant decision nodes and relationships and utilized Neo4j to create the KG. After obtaining the initial node features for building the graph embedding model, graph embedding algorithm, such as Node2Vec and GraphSAGE, were used to construct the GC-CDSS. At last, a retrospective cohort study was used to compare the consistency between GC-CDSS and MDT in treatment decision making. RESULTS: In current study, we introduce a GC-CDSS, which is constructed based on Chinese GC treatment guidelines knowledge graph (KG). In the KG, we define four types of nodes and four types of relationships, and it comprise a total of 207 nodes and 300 relationships. Regarding GC-CDSS, the system is capable of providing dynamic and personalized diagnostic and treatment recommendations based on the patient's condition. Furthermore, a retrospective cohort study is conducted to compare GC-CDSS recommendations with those of the MDT group, the overall consistency rate of treatment recommendations between the auxiliary decision system and MDT team is 92.96%. CONCLUSIONS: We construct a GC treatment support system, GC-CDSS, based on KG. The GC-CDSS may help oncologists make treatment decisions more efficient and promote standardization in primary healthcare settings.

Clinical decision support system supported interventions in hospitalized older patients: a matter of natural course and adequate timing.

BACKGROUND: Drug-related problems (DRPs) and potentially inappropriate prescribing (PIP) are associated with adverse patient and health care outcomes. In the setting of hospitalized older patients, Clinical Decision Support Systems (CDSSs) could reduce PIP and therefore improve clinical outcomes. However, prior research showed a low proportion of adherence to CDSS recommendations by clinicians with possible explanatory factors such as little clinical relevance and alert fatigue. OBJECTIVE: To investigate the use of a CDSS in a real-life setting of hospitalized older patients. We aim to (I) report the natural course and interventions based on the top 20 rule alerts (the 20 most frequently generated alerts per clinical rule) of generated red CDSS alerts (those requiring action) over time from day 1 to 7 of hospitalization; and (II) to explore whether an optimal timing can be defined (in terms of day per rule). METHODS: All hospitalized patients aged ≥ 60 years, admitted to Zuyderland Medical Centre (the Netherlands) were included. The evaluation of the CDSS was investigated using a database used for standard care. Our CDSS was run daily and was evaluated on day 1 to 7 of hospitalization. We collected demographic and clinical data, and moreover the total number of CDSS alerts; the total number of top 20 rule alerts; those that resulted in an action by the pharmacist and the course of outcome of the alerts on days 1 to 7 of hospitalization. RESULTS: In total 3574 unique hospitalized patients, mean age 76.7 (SD 8.3) years and 53% female, were included. From these patients, in total 8073 alerts were generated; with the top 20 of rule alerts we covered roughly 90% of the total. For most rules in the top 20 the highest percentage of resolved alerts lies somewhere between day 4 and 5 of hospitalization, after which there is equalization or a decrease. Although for some rules, there is a gradual increase in resolved alerts until day 7. The level of resolved rule alerts varied between the different clinical rules; varying from > 50-70% (potassium levels, anticoagulation, renal function) to less than 25%. CONCLUSION: This study reports the course of the 20 most frequently generated alerts of a CDSS in a setting of hospitalized older patients. We have shown that for most rules, irrespective of an intervention by the pharmacist, the highest percentage of resolved rules is between day 4 and 5 of hospitalization. The difference in level of resolved alerts between the different rules, could point to more or less clinical relevance and advocates further research to explore ways of optimizing CDSSs by adjustment in timing and number of alerts to prevent alert fatigue.

Postmenopausal endometrial non-benign lesion risk classification through a clinical parameter-based machine learning model.

OBJECTIVE: This study aimed to develop and evaluate a machine learning model utilizing non-invasive clinical parameters for the classification of endometrial non-benign lesions, specifically atypical hyperplasia (AH) and endometrioid carcinoma (EC), in postmenopausal women. METHODS: Our study collected clinical parameters from a cohort of 999 patients with postmenopausal endometrial lesions and conducted preprocessing to identify 57 relevant characteristics from these irregular clinical data. To predict the presence of postmenopausal endometrial non-benign lesions, including atypical hyperplasia and endometrial cancer, we employed various models such as eXtreme Gradient Boosting (XGBoost), Random Forest (RF), Logistic Regression (LR), Support Vector Machine (SVM), Back Propagation Neural Network (BPNN), as well as two ensemble models. Additionally, a test set was performed on an independent dataset consisting of 152 patients. The performance evaluation of all models was based on metrics including the area under the receiver operating characteristic curve (AUC), sensitivity, specificity, precision, and F1 score. RESULTS: The RF model demonstrated superior recognition capabilities for patients with non-benign lesions compared to other models. In the test set, it attained a sensitivity of 88.1% and an AUC of 0.93, surpassing all alternative models evaluated in this study. Furthermore, we have integrated this model into our hospital's Clinical Decision Support System (CDSS) and implemented it within the outpatient electronic medical record system to continuously validate and optimize its performance. CONCLUSIONS: We have trained a model and deployed a system with high discriminatory power that may provide a novel approach to identify patients at higher risk of postmenopausal endometrial non-benign lesions who may benefit from more tailored screening and clinical intervention.